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Our focus now turns to algorithm design. An algorithm is a computational 
process for solving a problem. This definition has three important parts: 


Computational — the process must be something a computer could work 
through in a step-by-step manner, and all the necessary steps must be 
specified. Some things have no computational solutions. For example, 
even though you can detect that your program has an infinite loop, there 
is no generalized way for the computer to do this — meaning, yes, in 
certain special situations perhaps the computer can recognize there is an 
infinite loop...but usually those special situations don’t apply and usually 
the computer cannot recognize an infinite loop in general. 


Solving — the process must actually produce the desired solution. usually 
what is desired is an exact solution to the problem; sometimes all that 
is wanted is a solution that is “close enough” to optimal, where “close 
enough” has some formal definition. 


Problem — the process must solve the general problem, not just a specific 
instance of it. If you want to return the sum of five numbers, just re- 
turning the integer literal “2” is not an accurate algorithm, even though 
that solution does work in some cases. 


Algorithm design 


Our main focus for much of the next few weeks will be on algorithm de- 
sign. That is, we will be concerned with the creation of new algorithms first 
and foremost, as opposed to worrying about how to make the algorithm run 
as fast as possible, in a particular language, on a particular machine. Algo- 
rithms are mathematical, computational things. An algorithm is a process, 
a description of how to solve a problem. We can discuss whether the algo- 
rithm is sufficiently detailed to be translated into code, and we can discuss 
whether the algorithm solves our problem or not — all without needing to 
discuss actual code. 


example: given five numbers a, b, c, d, and e, find their product 

Algorithm 1: Find the product of the first two numbers. Multiply that 
product by the third number. Multiply that product by the fourth number. 
Multiply that product by the fifth number. 

Al 

It might seem like a silly example...and for integers it it. But, if our 
variables were matrices instead of integers, the difference between the two 
could be very important — the speed of the finding of the product could vary 
wildly depending on which matrices are multiplied together first. 


Recursion 


Factorial: 


fac(n) 


n! (that’s the notation) 


fac(m) = n * (n-1) * (n-2) * (-3) * 1... *2* 1 


Iterative version (i.e. using loops) 


int fac(int n) 


x 
int product = 1; 
for (int i =n; i<=1; i--) 
product *= n; 
return product ; 
} 


We could also define fac(n) a different way, in terms of itself. 


fac(n) = | n * fac(n-1) 
| 
fac(4) = 4 * fac(3) 
= 4 * (3!) 
=4* 6 
= 24 


This is called a recursive definition, because it is self-referential, i.e. the 
definition invokes itself on simpler data (usually a smaller set of data). 


Circular definitions would be bad: 
| 
fac(n) = | n * fac(n-1) 
| 


but recursive definitions are not circular. Instead, there is some eventual 
stopping case, so that you don’t keep re-invoking the definition forever. 
We need a stopping condition, commonly called a base case. What is a 


good base case for factorial? Well, 0! == 1, so let’s try n == 0 for our base 
case? If n == 0, then we can return 1. 

| 
fac(n) = | n * fac(n-1) 

| if a.“ o0 

| 

| 1 

| if n==0 

| 


int factorial(int n) 


1 
if (n==0) 
return 1; 
else 
return n * factorial(n-1); 
iF 


In terms of how much calculation is done, this algorithm takes about as 
long as the iterative version. In both cases, we perform n— 1 multiplications. 


